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Abstract 

In this paper we introduce hyperations and cohyperations, which are 
forms of transfinite iteration of ordinal functions. 

Hyperations are iterations of normal functions. Unlike iteration by 
pointwise convergence, hyperation preserves normality. The hyperation 
(/^}seOn of a normal function / is a sequence of normal functions so that 
/° = id, f 1 = / and for all a, /3 we have that f a+l3 = f a f '. These condi- 
tions do not determine f a uniquely; in addition, we require that {f a ) a eOn 
be minimal in an appropriate sense. We study hyperations systematically 
and show that they are a natural refinement of Veblen progressions. 

Next, we define cohyperations, very similar to hyperations except that 
they are left-additive: given a, /3, f a+l3 — f^f a . Cohyperations iterate 
initial functions which are functions that map initial segments to initial 
segments. We systematically study co-hyperations and see how they can 
be employed to define left inverses to hyperations. 

Hyperations provide an alternative presentation of Veblen progressions 
and can be useful where a more fine-grained analysis of such sequences is 
called for. They are very amenable to algebraic manipulation and hence 
are convenient to work with. Cohyperations, meanwhile, give a novel way 
to describe slowly increasing functions as often appear, for example, in 
proof theory. 

1 Introduction 

Cantor famously discovered ordinal numbers [2] when he needed to successively 
remove isolated points from a set of real numbers. Given a closed set A C K, he 
considered the set dA of all non-isolated point^] of A. The set dA may in turn 
posses isolated points, so we may remove these by considering d 2 A, and so on. 
Evidently d n+1 A C d n A for all n, and we thus obtain a decreasing sequence 

A D dA D ddA D . . . D d n A D... 
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However, it may very well be that the set Hn<w which one obtains at the 
end of this process still has isolated points. Thus it is convenient to continue 
the construction into the transfinite. To do this, let us denote the class of all 
ordinals by On and the class of limit ordinals by Lim, and dehnc 

1. d°A = A 

2. S +1 A = dSA for all £ G On 

3. d x A = P| d^A for A e Lim. 

By cardinality considerations, given a closed set A there must be an ordinal 
a such that d a A — d a+1 A, thus effectively removing all 'hereditarily isolated' 
points of A. 

However, this is not the only setting in which one may wish to iterate a 
function transfinitely. When working with sets, one has the convenience of 
infinitary operations (such as intersection) for defining limit iterates, but this is 
not necessary. If / : N — > N, one may well define transfinite iterations of / by 
diagonailzation. To be precise, let A be a countable ordinal such that for each 
A < A we have assigned a fundamental sequence (X[n]) n<iLl with the property 
that A = lim„_). w X[n]. 

Then, we may set 

1. /°(n) = n 

2- = /*(/(»)) 

If one begins with f(n) = n + 1, then one precisely obtains the Hardy hierarchy 
[9], while the sequence {f u }{eOn gives the fast-growing Wainer hierarchy [12] . 
Observe that for A € Lim, the definition of / A is somewhat ad-hoc, depending 
on our choice of fundamental sequence, while for successor ordinals the corre- 
spoinding iterate is determined by the previous ones. This is often the case; 
defining iterations at limit stages usually requires choosing a good option from 
many possible candidates, a phenomenon that we will also encounter. 

In this paper we are interested, specifically, in transfinite iterations of func- 
tions / : On — > On. Here, as in the set-theoretic setting, one has infinitary 
operations at hand (such as taking suprema and infima), but as we shall see 
defining transfinite iterations is not unproblematic, especially if one wishes for 
iteration to preserve structural properties of /. 

Perhaps the best-known example of a hierarchy of ordinal functions is given 
by Veblen progressions, introduced in |17) . Recall that if / = /o is some normal 

2 That is, strictly increasing and continuous. We use continuous in the sense of the order 
topology on ordinals, so that / is continuous if /(A) = lim^^ /(§) for A £ Lim. Since normal 
functions are increasing, if / is normal one may replace this condition by /(A) = sup^ <A /(£)• 
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function and a an ordinal, f a in the Veblen progression of / is the normal 
function that enumerates in increasing order the class of ordinals 

U I V/3<a, /£(£)=£}; 

we will discuss these in greater detail later. Veblen progressions may be used 
to give systems of ordinal notation below the Feferman-Schiite ordinal, Tq [H 
[T5] . The method may be generalized to generate larger ordinals; see [3] for an 
overview. 

However, Veblen progressions are not iterations in the sense we shall con- 
sider; for example, f% is not the same as /i ° /i- Iterations of ordinal functions 
in a sense similar to our own are discussed in [8] (where a category-theoretic 
view of Veblen progressions is also given). There, the authors consider iterating 
monotone functions by taking limits: 

Definition 1.1 (Left transfinite iteration). Let f : On — )• On. We define the left 
transfinite iteration of / as the unique sequence of functions TI/[/] = (/^)fjeOn 
given by the following recursion: 

1. f = id; 

2. r +l = /°r ; 

3. / A 7 = sup / Q 7 for A e Lim. 

As [8] already noted, TI; preserves weak monotonicity but not normality. 
Further, if / is continuous, then the sequence stagnates in the sense that /' = /" 
for all £ > uj; we shall discuss this in detail in the next section. One of our main 
objectives is to describe a notion of transfinite iteration of normal functions 
which does preserve normality and does not stagnate. We shall define such 
iterations and call them hyperations. 

Hyperations can be seen as a refinement of Veblen progressions. Much as 
with the Hardy and Wainer hierarchies, if (/^){gOn enumerates the hyperates 
of / while (f^teOn its Veblen progression, we have the relation 

r° = fa- 

Indeed, f a may be defined completely in terms of Veblen progressions. How- 
ever, we see at least three reasons why the hyperations viewpoint may often be 
useful: 

1. it places the Veblen hierarchy in a new light providing an alternative 
presentation; 

2. the algebraic structure that comes with hyperations is very convenient, 
facilitating applications, as the authors have found [5j[7]; 

3. hyperations naturally give rise to a uniform theory of certain well-behaved 
left-inverses of hyperations that we call cohyperations. 
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Cohyperations also come with a beautiful algebraic structure. We shall see 
that cohyperation is the proper notion for transfmitely iterating initial func- 
tions, which are ordinal functions that map initial segments to initial segments. 
As such, cohyperations give rise to rather slow-growing ordinal functions. In 
various parts of proof theory slow growing functions on the natural numbers 
play an important role (see for example [HI [HI LB] ) ■ The slowly-growing cohy- 
perations may well give rise to other useful examples of slow-growing functions 
on the natural numbers, although at this point this is still speculative. 

As an academic curiosity by itself it is worthwhile to pursue a notion of 
transfinite iteration for ordinal functions outright, but the notions of hypera- 
tions and cohyperations were originally developed by the authors when working 
in the field of transfinite provability logics [6J [7] in order to extend many ex- 
isting techniques into the transfinite setting. Provability logics, aside from being 
complex and fascinating on their own right, have been used by Beklemishev to 
give an ordinal analysis of Peano Arithmetic and related systems [T] . We believe 
our efforts will lead to similar applications to much stronger systems, such as 
Predicative Analysis. 

Plan of the paper. In Section [2] we set the scene for our definition of 
transfmitely iterating normal functions and motivate the choices we made. In 
Section [3] we introduce the basic notions of ordinal arithmetic that we need for 
our study. 

Then, in Section|4]we define hyperations as minimal transfinite iterations of a 
normal function. We establish the main properties of hyperations. In particular 
we provide two characterizations, a recursive definition and one characterization 
in terms of Veblen progressions. 

Next, Section [5] defines left adjoints to normal functions, which are partic- 
ularly well-behaved inverses. Section [5] then introduces exponentials and loga- 
rithms, which are important examples of ordinal functions in our setting. 

Section [7] introduces cohyperations, another form of iterations which are dual 
to hyperations. Like with hyperations, we prove the essential properties of 
cohyperations and give a recursive characterization for them. Section [8] then 
goes on to discuss exact sequences, which are very closely tied to cohyperations. 

Finally, Section[9]relates hyperations and cohyperations by showing that the 
latter provide left-inverses for the former. As an important example we mention 
hyperexponentials and hyperlogarithms. 

2 Left vs. right additivity 

Let us restrict our attention in this section on how to transfmitely iterate normal 
ordinal functions; that is, ordinal functions / that are strictly monotone, i.e., 
a < (3 => f(a) < f(f3), and continuous in the sense that /(A) = lim /(£), for 

£ — >A 

A e Lim. 
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Let us start out by considering TI; [/] . If / is normal, we can prove by an 
easy induction on fj that 

f a+f3 = f°f a . (1) 

We call this property left additivity. We should remark that in this paper we 
often denote composition by simple juxtaposition, so we will often write left 
additivity as f a+ P = J' 3 /". We are also relaxed about writing parentheses 
around arguments, using /(£) and /£ indistinctly. 

Left additivity is a natural condition to demand of a sequence of transfinite 
iterations of a function /. Indeed, one would readily associate it with iteration 
and, for example, expect that 

r +1 = /°r ; 

|16j . for example, uses left-additivity in defining iterations. Unfortunately, there 
are no non-trivial left-additive sequences of normal, or even injective, functions: 

Lemma 2.1. Suppose that the sequence of functions (/OfeOn satisfies (QJ) and 
f is not the identity. Then, for any infinite ordinal £, _p is not injective. 

Proof. Let 7 be such that 7 ^ f(j)- 

Since £ is infinite we have that !+£ = £, and we see that 

/V(7) = f 1+ Hl) = /%)• 

□ 

Thus, left additivity is enough to discard having injective iterations of injec- 
tive functions, which is desirable for our purposes. A first attempt to avoid this 
problem is to work with a slightly different definition of transfinite iteration: 

Definition 2.2 (Right transfinite iteration). Let f : On — > On. We define 
the right transfinite iteration of / as the unique sequence of functions TI r [/] = 
(/^)jgOn given by the following recursion: 

1. f = id; 

2 fa+ i = f« Q f. 

3. / A 7 = sup / Q 7 for A £ Lim. 

Q< A 

Note that the only difference with TI/ is Clause 2, where / is now applied 
on the right. If / is continuous, it is easy to see that under this definition each 
f a is continuous and by induction on (3 we can prove that 

f a+f) = f a °f. (2) 

We refer to this property as right additivity. 

In fact this condition does have advantages; ([2]) alone is compatible with 
injectivity and even strict monotonicity of all iterates even if / is not the identity. 
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However, the recursion TI r [/] is still not too useful when / is a normal function, 
as it does not in general yield normal functions. For example, if we consider the 
normal ordinal function / = a n> 2 a then our definition gives 

/"0 = f u l = u. 

What is more serious is that both TI/ and TI r stabilize after u iterations 
when / is continuous: 

Lemma 2.3. Let f be a continuous function, and let TI/ [/] = (g^)^o n , TL-[/] = 
Then, for all £ > u , = g* = . 

We will skip the proof which follows a simple induction, but it suffices to 
observe that 

S w+ V) = fgT(a) = f lim P(a) = lim f n+1 {a) = 9 w (a); 

n— >oj n— ¥uj 

note that we are using the continuity of / in the third equality. 

Evidently, having notions of iteration which stagnate at u is highly undesir- 
able. One way out of this is to drop the limit condition from TI r and replace it 
by (J21)- Thus we arrive at a notion of transfinite iteration that we call weak hy- 
peration; a weak hyperation of a function / is any sequence of functions (g^)^o n 
such that 

g° = id: 

g 1 = /; 
g a+p = g a °g p - 

As we shall see, weak hyperations already have many desirable properties. How- 
ever, they are not uniquely defined by the above condition; any normal function 
/ has many weak hyperations. A canonical candidate may be chosen by im- 
posing a minimality constraint. We shall refer to this unique minimal weak 
hyperation as the hyperation of /. In Section [H we will give a detailed defini- 
tion as well as a thorough treatment of the basic properties of hyperations. 

As mentioned, we shall prove that there is a very tight connection between 
Veblen progressions and hyperations and in particular that hyperations can be 
defined in terms of Veblen progressions, and vice-versa. However, one of the 
main advantages of our hyperations is that they allow for a uniform treatment 
of left-inverses with various desirable properties. We call these left-inverses 
cohyperations. 

Cohyperations transfinitely iterate initial functions, that is, functions map- 
ping initial segments to initial segments. The definition is similar to that of 
hyperations, except that a cohyperation (<?^}££On is left-additive and pointwise 
maximal instead of minimal. These will be treated in Section [7] 
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3 Ordinal arithmetic 



Before continuing, let us give a brief review of some basic notions of ordinal 
arithmetic. We skip most proofs; for further details, we refer the reader to a 
text such as [TU] or [TB"] . 

Ordinals are canonical representatives for well-orders. The first infinite or- 
dinal is as always denoted by uj. Most operations on natural numbers can be 
extended to ordinal numbers, like addition, multiplication and exponentiation 
(see [13]). However, in the realm of ordinal arithmetic things often become more 
subtle. For example l-{-ui = Li^u)-\-l, so addition is non-commutative. Other 
operations also differ considerably from ordinary arithmetic. 

Fortunately, there are various similarities. In particular we have a form of 
subtraction available. 

Lemma 3.1. 

1. Whenever there exists a unique ordinal r\ such that £ + rj = £. We 
will denote this unique n by — Q + £. 

2. Given r\ > 0, there exist ordinals a, (3 such that rj = a + ut 13 . The value of 
(3 is uniquely defined. We will denote this unique (3 by In. 

3. For all rj > 0, there exist a, (3 such that n = u a + (3 and (3 < uj a + j3. The 
values of both a and f3 are uniquely defined. We denote a by Ln. 

One of the most useful way to represent ordinals is through their Cantor 
normal form (CNF): 

Theorem 3.2 (Cantor normal form theorem). 

For each ordinal a there is a unique sequence of ordinals ax > . . . > a n such 
that 

a = uj ai + ...+w Q ". 

We call a function / increasing if a < f3 implies /(a) < /(/?)• An ordi- 
nal function is called continuous if lim£_>£ /(C) = /(£) for all limit ordinals £. 
Functions which are both increasing and continuous are called normal. 

It is not hard to see that each normal function has an unbounded set of 
fixpoints. For example, the first fixpoint of the function <p : £ >— > uj^ is 

supjw,^,^,...} 

and is denoted eq. Clearly for these fixpoints, CNFs are not too informative as, 
for example, £o = lo e ° . To remedy this, one may use notations and normal forms 
that are slightly more informative and can represent the fixpoints of normal 
functions, as is the case of Veblen Normal Forms (VNFs). 

In his seminal paper |17j . Veblen considered for each normal function / its 
derivative /' that enumerates the fixpoints of /. If / is a normal function, then 
the image of / -which we shall denote by F- is a closed (under taking suprema) 
unbounded set. Likewise the function that enumerates a closed unbounded set 
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is continuous. For / a normal function, we define F' to be the image of /' and 
we extend this transfinitely by setting 

:= F- 
F a +i := {Fa)'', 
F x := P| F a for limit A. 

Q< A 

We then define fx to be the function that enumerates F\ and write Veb[/] = 

{f\)\£On- 

By taking <p := £ n- uj*, one obtains the familiar Veblen functions ip a . 
However, Veblen progressions can be constructed out of any normal function. 

We can often write an ordinal uj a in many ways as tp^{rj). However, if we 
require that 77 < ip^(rj), then both £ and 77 are uniquely determined. In other 
words, for every a, there are unique ordinals 77, £ such that 

1. Lo a = <p^(r]) and 

2. 7] < (p e (j]). 

Combining this fact with the CNF Theorem one obtains Veblen Normal Forms 
for ordinals. 

Theorem 3.3 (Veblen Normal Form Theorem). For all a there exist unique 
ai,/3i, . . . , a n , j3 n (n > 0) such that 

1. a = (p ai (Pi) + ... + <p an (/3n), 

2. ip ai {fi%) > ^Q I+ i(ft+i) for i < n, 

3. fa < tfoiiPi) for i < n. 

Note that 014 > 04+1 does not in general hold in the VNF of a; for example, 

u £ " +1 + £0 = M<PMo)( Q ) + <PoQ)) + ^o(o)(0). 

It is convenient to also define Veblen functions "from below". For this we 
use the following useful fact: 

Lemma 3.4. Let f be a normal function and £ an ordinal. Then, £ = limn-^ /"(£) 
is the least fixed point of f greater or equal to £, that is, it is the least ordinal 
such that 

e<c = /(0- 

Proof. By Lemma l2.31 / o Iim,,-^ /" = lim„_s. w / n , so that £ is a fixed point of 
/■ 

Now, in order to see that it is the least such fixed point, let us assume that 
/(£) 7^ £ (otherwise £ = £ and there is nothing to prove). Then, by an easy 
induction it follows that /"(£) < f n+1 (0 for all n. 

Pick any n G (£,C) an d let N be the greatest number such that f N (£) < n; 
such an N exists since (/ n (0)?eOn is an increasing sequence converging to (. 

But then f N+1 (rj) < f(r]), and by maximality of N we also have that n < 
f(rf), i.e., r\ is not a fixed point of /. □ 
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As a corollary we also get that lim n _>. w /"(£ + 1) gives the smallest fixpoint 
of / which is greater than £. This observation is an essential ingredient in giving 
a recursive definition of Veblen progressions: 

Below, f£ denotes (/f) n , which is typically not equal to (/""){• 

Theorem 3.5. Let f be a normal function an let Veb[/] = (/{){eOn- 
Then, 

1. for all He On, f 6 +i(0)= lim f?(0) 

2. for all £,a G On, f s+1 (a + 1) = lim f£(f s+1 (a) + 1) 

3. for all A G Lim ; / A (0) = lim / e (0) 

£— s-A 

4- for all A G Lim and a G On, /a (a + 1) = lim f^(f\(a) + 1) 

>A 

5. /or aZZ ^ 6 On and a G Lim, /5(a) = lim f^(P). 

Although we will not prove this result, note that Item 2 follows from Lemma 
13.41 we have that lim f 7 ^ l (f^ + i(a) + 1) is the smallest fixpoint of greater than 

/^+i(a), which is precisely the meaning of f^ + i(a + 1). 
We are now ready to begin the study of hyperations. 

4 Hyperations 

Hyperation is a form of transfinite iteration of normal functions. If / is a normal 
function, we wish to define the hyperates (f^)^eOn of /, where £ is an arbitrary 
ordinal, in such a way that is always a normal function and, in accordance 
to our considerations from Section [21 /* + ^ — /*/ . 

4.1 Weak hyperations and hyperations 

Recall that On denotes the class of all ordinals and Lim the class of limit ordinals. 

Definition 4.1 (Weak hyperation). Let f be a normal function and A be either 
an ordinal or the class of all ordinals. 

A weak hyperation of f is a family of normal functions {g^)^<\ such that 

1. g°Z = Z for all £, 
2- g 1 = f, 

3. g^ + ^ — g^gt whenever I; + ( < \. 
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In general, a normal funcion has many weak hyperations; the values of g u 
are not uniquely defined, given that u cannot be written as a sum of smaller 
ordinals. The same can be said of all g u for 5 > 1. However, weak hyperations 
are all rather well-behaved, as witnessed by the following lemma: 

Lemma 4.2 (Properties of weak hyperations). Any weak hyperation (g^)^On 
has the following properties: 

!■ if € < C then g^a < g^ct, 

2. //i • C C then rr//- 

3. if r] < uj p then 

g"(5" P (0 + i)<.9" P (^ + i)- 

Proof. 

1. If £ < £ and a is any ordinal, then g^a = g^ g~^ +l ^ a; but g^^ +t ^ is a normal 
function so g~£ +t *a > a, thus g^g^^ + ^a > g^a. 

2. By right additivity we have that g'' = g^ + ^ = g^g''. 

3. First note that 

^ p (0 + i<5" p (e + i) 

because g^ is increasing. 

Meanwhile, r\ < w p so n + lu p = ui p , hence 

W(0 + 1) < ffV'ce + 1) - 5" p (e + 1). 

□ 

Corollary 4.3. Let f a be a weak hyperation. Then all values of f> are fixpoints 
of /' whenever £, + ( = (. 

Proof. Immediate from Lemma 14.21 2. □ 

The following lemma tells us that we can weaken the requirement of addi- 
tivity in the definition of weak hyperations to a few special cases. 

Lemma 4.4. Let g = (<?^}f <a be a family of normal functions. 
Then, the following are equivalent: 

1. g is a weak hyperation of f . 

2. g has the following properties: 

(a) g Q !i = H for all £, 

(b) g 1 = f, 

(c) 3 cjP+ ' 5 = g uf V whenever £ < u> p + £ < A. 
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(d) g w = g w g"" whenever uj s < uj p < A. 

Proof. Clearly the first item implies the second, particularly in view of Lemma 
IP1 

To see that the second implies the first, it suffices to show that g is right 
additive, that is, g^ +t ^ = g^g 1 ' whenever £ + £ < A. 

We proceed by induction on £. For the base case, note that 

independently of £, given that g° is the identity. 

For the inductive step, suppose £ + £ < A and £ > 0. The case for £ = is 
analogous to the case £ = 0, so we assume £ > 0. 

Write £ = £' + w a (so that £' < £) and £ = u/ + £', with £' < £. By induction 
on £' < £, we assume that +l5 = g^ g 6 whenver £' + -Q < A. In particular, 

gt = gt' +ua =9 6 'g ua . 

Now we consider two cases. First, assume a < (3. In this case, oj a +oj 13 — . 
Meanwhile, by Property (d), g^° g uP — g^ and we have that 

■h.c = <r<r <r / = <r ; r / = ,r <r :;I / +c = tfi* 

Now, if a > j3, we have that £ < u a + £ and thus by using Property (c) we 
get that 

as desired. □ 

Definition 4.5 (Hyperation). A weak hyperation (<?^}{eOn of f is minimal if it 

has the property that, whenever (/i^)^ e on is a weak hyperation of f and £, £ are 
ordinals, then <?^£ < /i^£. 

// / has a minimal weak hyperation, we call it the hyperation of f and denote 
>' H.vp/ . 

Note that hyperations, if they exist, are unique. It is also the case that they 
always exist; for this, we will establish an explicit recursion scheme to compute 
the unique hyperation of a normal function /. In particular, we see that the 
inequality we proved in Lemma 14.21 3 is optimal as equality is attained in the 
limit for hyperations. 

Theorem 4.6. Every normal function f has a unique hyperation Hyp[/] = 
(/^}§eOn o,nd it is given by the following recursion: 

1- A = £: 

2. f 1 = f, 

3. = f u "f ( , where < £ < u p + £,. 
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4. f u '0 = Km C -+ u ,f<0 for p>0, 

5. r P (C + 1) = lim c ^P / C (r"(0 + 1) /or p > 0, 

6. /" P £ = lim f _> ? / W "C /or £ £ Lim and p > 0. 

Proof. By an easy induction on a and an auxiliary induction on /3 we readily 
see that / Q (/3) is well-defined for all a and /3. Thus, we must show that 

1. (/^}feOn is a weak hyperation and 

2. if (g^)^eOn is another weak hyperation, then g^£ > /% for all £, £. 

For the first point, we first need to show that always normal, i.e., strictly 
increasing and continuous. 

This is clear whenever £ is of the form lj p + £' with uj p + £'>£' > 0, since 
compositions of normal functions are always normal. Thus we may assume 
£ = u". 

The continuity of /* is evident from Clause 6. To check that is increasing 
it suffices to verify that f^£ < /*(C+ 1) for all £, but by induction, f n is normal 
for all r) < £, thus /"(/""(C) + 1) > /""C + 1 and 

I™ p(r p (o + 1) > r p (o + 1 > r p (o- 

Hence it remains to show that (/^}{eOn is additive. To do this, we will prove 
by induction on A that (/^)^<a is a weak hyperation. 

In view of Lemma [4.41 it suffices to check that /" f uP £ — f u)P £ whenever 
£ G On and uj s < lo p < A. By induction we may assume that (f v ) ri <uii> is a weak 
hyperation. 

We then proceed case by case depending on whether £ is zero, a successor 
or a limit ordinal. Here we shall only consider the case £ = £ + 1, which is the 
most involved: 

r s r p £ = r s Hm r cr p (o + i) 
= iim r>cr p (o + i) 

rj— >co p 

S Jim p f^(f'(() + l) 

= Vm r(r p (o+i) 

77— yuP 

= f uP £. 

Now we must check that if g is a weak hyperation of /, /% < for all 
£, £• We can assume £ > 1, for otherwise there is nothing to prove. 

We then establish the claim by induction on £ with a subsidiary induction 
on £, assuming it for £',£', where either (i) £' < £ or (ii) £' = £ and £' < £. 

As before, this proceeds case-by-case, where each argument is similar. For 
example, assume £ = and £ <E Lim. We then have that f v Q < g^O for f] < £; 
because g v < g^O (Lemma I4.2[) . it follows that 

/ s = lim P0 < lim g^O < g^O. 
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Once again, the most involved case is where £ = lu p and £ = a + 1. Here we 
must observe that 

P{r P {a) + l)<cf(g^{a) + l). 
This follows from our induction hypothesis since 

/"(r P (a) + 1) < W(a) + 1) < + 1), 

where the first inequality follows by induction on a < ( and the second by 
induction on rj < £. 
It follows that 

/" P C= lim f(r"a + l)< Um j'(/« + l)</(, 

as claimed. □ 
Let us include an easy example to see how the recursion works. 

Example 4.7. Recall that we defined tp(a) — w°, and that the fixpoints of <p 
are the epsilon numbers (e^eOn- 
Let (^}^ e on = Hyp [p]. 

Then, we have that ip u \ = E\, that is, (p u l equals the second-smallest fixpoint 
of the map a \— > uj a . 

Proof. We first compute 

tp w = lim ip n (0) = lim tp n (0). 

By Lemma l3.4[ this limit defines the first fixpoint of a i— > cu a , normally denoted 
£q. Likewise, we compute 

tfPl = lim ip n ((p u (0) + 1) = lim ip n (e + 1). 

n— >lo n— >lj 

Again by Lemma l3.4| this is the smallest fixpoint of <p which is larger than eq, 
whence it is the next epsilon number, i.e. e\, as was to be shown. □ 

This is a special case of the more general equality 

</?"£ = ¥>i£ = 

we will return to this in the next section. It should also be noted that hypera- 
tions of hyperations behave as one would expect: 

Lemma 4.8. If f is any normal function and£, £ are ordinals then (f^)^ = , 
where (/")„ e0 n = Hyp[/] and ((/«)")„eOn = Hyp[/«]. 
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Proof. We show that (f^pa — f^a by induction on £ with an auxiliary induc- 
tion on a. 

For C = there is nothing to prove and, if C = 7 + 8 with 8 < £, then 

(/*) 7+(5 = (f^Vif^) 6 = f^~"f^ s — ft' 1+ ^' s — ft'(~t +s \ 

Otherwise, ( = ui~ / for some 7. We note that in this case, £ • oj 7 = or for 
some 5. 

Then we must consider three cases, depending on whether a is zero, a suc- 
cessor or a limit ordinal. 
In case a = we see that 

(/«) c = lim(/ c )"0 = lim /« "0 = lim /"0 = f^O. 

Note that ui s = lim^_ ) . LJ 7 since multiplication is continuous on the right-hand 
argument. 

In the successor case, we write a = ft + 1. Then, 
(f^a = lim J/«)"((/*r T (/3) + l)= hm r'(.r\/3) + l) = r 5 a, 

where in the inductive step we are simultaneously using (f^)^ (3 = f" p by 
induction on /3 < a and (/^) r ' = by induction on r\ < ( = w 7 . 
The limit case follows from 

(/«r T a = lim (/«r 7 /3 1 lim /"'/3 = a. 

p^ra p— ya 

□ 

4.2 Hyperations and Veblen progressions 

We shall now see that Veblen progressions can be naturally embedded in our 
hyperations. The steps in the Veblen progressions correspond to specific iterates; 
as such, hyperations form a natural refinement of Veblen progressions. 

Troughout this subsection, given a normal function /, Veb[/] = (/ Q )aeOn 
and Hyp[/] = (f a ) ae0n . 

Lemma 4.9. Given a normal function f and an ordinal a, we have that f u = 

Proof. We prove the lemma by induction on a. By definition we have f" = fo 
which settles the base case. 

For a+1 we proceed to prove that f u j3 — f a +i/3 by a subsidiary induction 
on j3 considering several cases. For j3 = we see that 

f u " +1 0= lim f u " n 0= lim(/" cv )™0= lim (/ Q ) n 0. 

n—tuj n—^-uj n—¥u) 



But by Theorem E51 lim n ^ w (/ a )"0 = / a+1 0. 
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Likewise, for (3 + 1 we see that 

r° +1 (/3 + 1) = lim (f°)"(f" +I (ffl + 1) 

n— >oj 

S lim(/ a r(/ a+1 (/3)+l) 

n— 

= / a+1 (/3 + l). 

The cases for limit /? or limit a are similar and we omit them here. □ 
Corollary 4.10. If 



a 



then 



rc = /« ■■•/«„ (0 

/or any ordinal £• 

Proof. Directly from Theorem 14.91 and the fact that we have = /v*. □ 

We thus see that hyperations define Veblen progressions. As such hypera- 
tions are natural refinements of them and a Veblen progression Veb[/] comes 
with a corresponding refinement Hyp[/]. We shall now see that Veblen progres- 
sions in their turn uniquely determine weak hyperations. 

Theorem 4.11. Let g = (g^)jgon be a weak hyperation of a normal function 
f . If we moreover have that = f a for each a then g = Hyp[/]. 

Proof. Write £ = a/ 1 + . . . + iu^ n in CNF. By additivity we see that 

g^g^...g^\ 

which by assumption equals fa ■• ■ fe„ ■ By Corollary 14.101 it follows that = 
/ 5 , as claimed. □ 



5 Initial functions and left adjoints 

Normal functions are typically not surjective and hence non-invertible. However, 
being injective, they are always left-invertible. Further, if / is normal and gf 
is the identity, g is usually not normal. Initial functions, meanwhile, provide 
natural left-inverses for normal functions, in particular when they are also left 
adjoints. 

We will say a function g is initial if, whenever / is an initial segment (i.e., 
of the form [0,/3) for some 0), then /(/) is an initial segment. 

Lemma 5.1. If f is initial, then /£ < £ for every ordinal £. 
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Proof. By a simple induction on £. If / is initial we have that 

/[0,0 = [0,/3) 

for some 13; by induction on £, if £ < £ it follows that /(C) < C; an d thus 

/3<su Pc<c (c + i) = e 

Further, 

/[o,^] = /[o,0u{/(0} = [o,/3)u{/(0} 

must also be an initial segment, from which it follows that /(£) </?<£. d 

Let / be a normal function. Then, g is a Ze/i adjoint for / if, for all ordinals 

a, 13, 

a = f(J3) => g{a) = (3 (3) 

and 

a < f((3) => g(a) < (3. (4) 



Not all normal functions have left adjoints: 
Lemma 5.2. If a normal function f has a left adjoint, then /(0) = 0. 

Proof. This follows from the fact that, if a < /(0) and g is a left adjoint 
to f, then g(a) < 0, which is absurd; thus there can be no such a, that is, 
/(0) = 0. □ 

However, this is the only condition we need to have left adjoints of normal 
functions, which are always initial: 

Lemma 5.3. Let f be a normal function with /(0) = 0. 

Then, f has an initial left adjoint g. Further, if h is any left adjoint for f, 
then h is initial. 

Proof. The existence of a left adjoint is easy; simply consider g defined by 
g(/3) = a if f3 = f(a), g((3) = if there is no such a. 

Now, if h is a left adjoint for /, we claim that for all (3, h[0,/3] = ,/ _1 [0,/3], 
which is clearly an initial segment since / is increasing. This follows by induction 
on (3. 

First note that 

h[0,(3) = |J h[0,S] 2 |J /"MO,*] =/- 1 [0,)8). 

5</3 5<p 

Thus, h[0,f3]=f- 1 [0,f3)U{h(f3)}. 

Now, if (3 lies in the range of /, j3 = f(j) implies that / 1 {(3} — {7}, while 
h((3) — 7 because ft. is a left adjoint of /. It follows that {h(/3)} = f^ 1 {/?}, so 
that 

h[0,f3]=f- 1 [0,[3)Uf- 1 {[3} = f- 1 [0,[3]. 
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If P does not lie in the range of /, let 7 be the least ordinal such that 
f3 < 7(7). Then, h{(3) < 7, so that by minimality of 7, fh(j3) < f3 and thus 
h(0) e / _1 [0,,8); therefore, 

h[O,0\ = h[0,f3)U{h(f3)} = r 1 [0,P) = r 1 [0,f3}. □ 

Thus initial functions are natural inverses to normal functions. Because of 
this, later in the text we shall turn our attention to iterations of initial functions. 
But first, let us introduce some important examples. 

6 Exponentials and logarithms 

In this section we shall define some particularly natural and interesting ordinal 
functions from the point of view of our framework. After deriving some basic 
properties we see how to obtain an ordinal notation system from these new 
functions. 

6.1 Exponentials and logarithms 

By Lemma 15.21 we know that ip (the w-based exponential) does not have any 
left adjoint. However, we can introduce a mild modification which does. 

Set e(£) = — 1+aA Note that e(£) = unless £ = 0, in which case e(0) = 0. 
The advantage of e over ip, as mentioned, is the existence of left adjoints. We 
mention two: 

1. The left-logarithm, first exponent or greatest exponent L, where £(£) is the 
unique ordinal a so that £ = us a + (3 with /3 < u a + f3. We set L(0) = 0. 
We remark that, given £, £, 

(a) L(£ + C) =max{L(0,i(C)} and 

(b) L(C-0=L(0+L(0. 

2. The end-logarithm, last exponent or least exponent I assigns to an ordinal 
£ the unique S such that £ can be written in the form 7 + oj s ; we also set 
^0 = 0. Here we see that 

(a) l(£ + and 

(b) e(£-Q=Lt + %. 

Exponentials and logarithms shall provide us with key examples of functions 
to hyperate and cohyperate, respectively, and indeed are the authors' motivation 
for the present work, due to their applicability to provability logic [SJ [7] . 

It is convenient to relate the Veblen progression (ej)j e on with (ip^)^^o n : 

Lemma 6.1. Given ordinals a, (3, (e^gon = Veb[e] and (^>^}^eOn = Veb[y>], 
1. e Q (0) = 0, 
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2. e Q {l + [3) = <p Q {l + [3), 

3. e 1+a {l + f3) = ip 1+a ({3). 
Proof. 

1. Since eo(0) = 0, is a fixed point of eo and, by an easy induction, one can 
check that it is a fixed point of all e$. Thus e^(0) = for every £ £ On. 

2. Obvious from the definition of e = eo. 

3. Let us prove this claim by induction on a. Here it suffices to check that, 
for all a' < a, 1 + /3 is a fixed point of ei +Q < if and only if it is a fixed point of 

(Paf, 

Observe first that all non-zero fixed points of eo or (pg are infinite, so that 
1 + $ = f3. Thus 

e a ,C3)=/?™ ¥ v(l + /3) =p 

□ 

Example 6.2. In view of Example \ 7. 6\ we must have that 

ei(2) = ^(l)=ei. 

6.2 Weak normal forms 

Hyperations in general and hyperexponentials in particular can be used to give 
different sorts of notation system for ordinals. 

For example, given an ordinal £, we say an expression 

i<I 

is a Weak Hyperexponential Normal Form if /, n < u), < e Qi /3j for i < I and 
e ai f3i > e Qi+1 /3i+i whenever i < I. Note that Weak Hyperexponential Normal 
Forms are typically not unique. For example, w u = e 2 l = e l e l \. We do, 
however, have uniqueness if every is of the form oj s . 

Say an ordinal £ is definable by a set of ordinals O if £ has a normal form 
y^-w e ai ,3i + n where each a; 6 6 and, inductively, O defines each Every 
set of ordinals defines 0. 

Proposition 6.3. Every ordinal £ > has a weak hyperexponential normal 
form and hence is definable by O large enough. 

If we further require that every exponent be of the form lo s , then the WHNF 
obtained is unique. 
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Proof. Write £ in Veblen Normal Form and, in view of Lemma 16.11 replace 
ipa(P) by e"°(l + 0) for a > 0, ipo(P) by e 1 ^) for /3 > 0. The occurrences of 
V?o(0) can be captured in the term + n in the end of a WHNF. 

If all exponents are of the form oj 5 , we may invert the process to obtain a VNF 
from a given WHNF; the uniqueness of the latter follows from the uniqueness 
of the former. □ 

This proposition provides us one way to uniquely choose a particular WHNF. 
In [TT] it is shown that max{a | EI7 e Q 7 = oj 13 } exists for each ordinal j3. 
This gives rise to another unique WHNF representation where each on in £ = 
J2i<i eai Pi + n is chosen maximal. 



7 Cohyperations 

As mentioned in Section [2l left-additive iteration does not allow for injectivity 
and thus is not possible within the class of normal functions. However, left- 
additive iteration of initial functions can be defined and indeed is closely tied 
to hyperation; we will call this form of iteration cohyperation. Recall that a 
function is initial if it maps initial segments to initial segments. 

Cohyperations are tailored to yield left adjoints to hyperations; thus, as we 
observed in Lemma 15.31 we are bound to work with initial functions. More- 
over, left-additivity should naturally be associated to cohyperations; indeed, 
let (g^)^On be a family of left inverses to a weak hyperation (f^)^eOn (i-e., 
9 f = 'd f° r au 0' an d suppose that 7 = f a+ ^8. Observe that 

g g a f a+0 S = g p g a f a f 5 = g^fS = S. 

But at the same time 5 = g a+/3 j, and thus we have that 



Hence in order to produce left adjoints to hyperations we shall first turn our 
attention to developing a theory of left-additive iterations of initial functions. 



7.1 Weak cohyperations 

Much of the work for cohyperations is analogous to that for hyperations, al- 
though there are important differences. As before, we first define weak cohyper- 
ations of a function /, and now impose a maximality condition to pick out the 
cohyperation of /. 

Definition 7.1 (Cohyperation). Let A be either an ordinal or the class of all 
ordinals and let f be an initial function. 

A weak cohyperation of f is a family of initial functions (g^)^<A such that 

1. ,/X = £ for all i\ 

*■ g 1 = f, 



19 



3. ,r- ;r <r- 

If A — On and g is maximal in the sense that 3 5 C > h( C for every weak 
cohyperation h of f and all ordinals £, C, we say g is the cohyperation of f and 
write coH[/] = (3 C ) ?e on- 

Weak cohyperations also have some nice properties. The proofs of the fol- 
lowing two results are very similar to their hyperation analogue and we omit 
them. 

Lemma 7.2 (Properties of weak cohyperations). If (<7*)f<A is a weak cohyper- 
ation of f , then 

1. g^a < g^a whenever £ < 

2. g^a = g^g^a whenever £ + ( = £. 

Lemma 7.3. Let f be an initial function and let g — (<?^)£<a be a family of 
initial functions. Then, the following are equivalent: 

1. g is a weak cohyperation of f ; 

2. g satisfies the following: 

(a) g°a = a, 

(b) g 1 = f, 

(c) = g^g u " provided £ < u p + £, 

(d) g^ S, = g u " g u £ whenever S < p. 

The clause <?" P £ = g^ g u " £ will imply that computing <?" P £ can often be 
reduced to computing g u g n ^, for appropriately chosen rj. The next lemma will 
give us an especially convenient candidate. 

Given ordinals a, £ and a family of functions / = (/ ,? )i ) <5, we define rf(f , £, a) 
as the least ordinal rf < £ such that 

f n a = min f v a. 

Thus, rj* is the least value which minimizes f v a. In particular, if / is the 
identity, then rj* > if and only if f v a < a. 

Lemma 7.4. Given a weak cohyperation g = (g^)^<A, ordinals £, a and rj* — 

"n* %£,,<*), 

1. g n a > g n a whenever rj < rf and 

2. g n a — g n a whenever rj* < rj < £. 

Proof. The first claim follows from the minimality of rf and indeed does not 
depend on left additivity. 

Meanwhile, if rj 6 [??*,£), we use Lemma \7. 21 1 to see that g n a < g n a, but 
by the minimality of g n a, equality must hold. □ 
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7.2 Cohyperations 

With the definition of rf we can give a recursive definition for a weak cohyper- 
ation for an initial function / which, we shall see, gives us the cohyperation of 
/. However, until we prove this fact we shall call it the recursive cohyperation 
of /: 

Definition 7.5 (Recursive cohyperation). Given an initial function f , we define 
a sequence of functions coH'[/] = (/^}{eOn by the following recursion: 

1. f°a = a, 

2. f*0 = 0. 
3- f 1 = f, 

4. /" p +? = /«/" p provided ujP + £ < £, 

5. if p > and n* = 77* (coH' [/] , uj p , a) > 0, then 

6. if p > andr)*(coR'[f],ujP,a) = 0, then 

r P a= sup (r P (/3) + l). 

06[O,a) 

Later we will show that coH'[/] = coH[/], but this will require some work. 

First, let us include a simple example to see the recursive definition at work. 
Recall from Lemma |3. II that £(a) denotes the last exponent of a when written 
in CNF. 

Below, write coH'[^] = (^)feOn- 

Example 7.6. i w e x = 2. 

Proof. It is not hard to see that £ is indeed an initial function. We will first 
compute £ u £$. Clearly, for each n < to we have that £ n Eo = £0 whence 
77*(coH'[4w,£ ) = and 

Pe = sup (£"(/?) + 1). 

Now, for any /3 < £0, there is some n < to with £ n (3 = 0, whence 

f /3 = £ n+ul f3 = f£ n [3 = fO = 0. 

Consequently, £"e = sup^ e[0>£o) (^ w (/3) + 1) = 1. 

Now we can compute £ U E\. Again, for all n < w, £ n S\ — S\ so that 
r?*(coH'[£],w,£i) = and 

fei= sup + 
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So, we first need to compute £ u f3 for any j3 e (eo,ei). A straightforward in- 
duction shows that for each such (3 we can find a large enough n < u so 
that either £ n f3 — or £ n f3 — Eq, given that £ has no fixpoints in this in- 
terval. Thus, £ u /3 = £ u £ n (3 which is either or £ u e = 1. Consequently, 
^ei = BU Pi9€[0iei) (^C8) + l) = 2. □ 

The next few lemmas will be used to prove that coH'[/] = coH[/]. 

Lemma 7.7. If f is an initial function and (/^){eOn = coH [/], then is an 
initial function for all £. 

Proof. The identity, i.e. /°, clearly is an initial function. We proceed by induc- 
tion on £, assuming that /' is an initial function for all £' < £. 

For the case £ = 7 + 5 with 7, 5 < £, a very easy argument shows that the 
composition of initial functions is initial, so is initial. 

Now, assume £ = w p . Let us check that / w is initial. Assume /'' is initial 
for all n < <jj p . We will prove, by a subsidiary induction on Q, that /" P [0, £] is 
an initial segment, assuming that, given £' < £, /" P [0, £'] is an initial segment. 

First we note that. 



r p [o,c] = {r p c}u u /w'] 



C'<C 

and by induction on £, U<;'<<; .f[0>C'] i s an initial segment, given that it is a 
union of initial segments; call it [0,/?). 

Now, if 77* = 77*(coH'[/], u;P, Q > 0, we see that p*( < C and thus 

so that /" P [0, ("] = [0,/3), an initial segment. 
Otherwise, 

r p c = sup (r p (tf) + i) = /?. 

»e[o,C) 

Thus 

r p [o,c] = [o,/?], 

which is also an initial segment, as claimed. □ 

Lemma 7.8. If f is an initial function, then (f^)^eOn — coH [/] is a weak 
cohyperation of f . 

Proof. Let us show by induction on A that (/^}^<a is a weak cohyperation. 

We have seen in Lemma 17.71 that is initial for all £. Thus, in view of 
Lemma IT3I we must check that 

jv'+e = ftp* (5) 

provided £ < ui p + £ < A and 
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whenever u/ < oj p < A. We may assume, inductively, that (P)^< u p is a weak 
cohyperation. 

Note, however, that (|S|) is satisfied by the definition of /" P+ ^, so it suffices 
to show ©. More generally we shall show that, if r] < ui p and £ is any ordinal, 

f p C = r7% 

li PC = C) there is nothing to prove. Hence we are left with the case < C, 
which in particular implies that 77* = rf (coH'[/], lu p , £) is non-zero. 

Here we must consider two subcases. The case 77 > 77* is easy, since P C = 
f n ( and by definition f ( = f u p £; thus we focus on the case 77 < 77*. 

By induction on PC < £, we may assume that, given t? < oj p , 

r7 n c = r77 n c = r p p + \, 

where the second equality uses the hypothesis that (/^)^< w p is a weak cohyper- 
ation. 

In particular, for t9 = —77 + 77* we see that 

r p pc = r p r\ = r'c 

Setting 77 = lu 5 we obtain ([6]) . □ 

Now that we see that the recursive cohyperation actually defines a cohyper- 
ation we are allowed to replace the clauses 5 and 6 respectively by 

5'. If p > and pa < a for some 77 < w p , then /"'a = f" Pa, 

6'. If p > and pa — a for all 77 < uj p , then 

P p a= sup (r P (/3) + l). 

/3e[0,a) 

We are almost ready to prove that that the recursive cohyperation actually 
defines the unique cohyperation, but we first need a technical lemma. 

Lemma 7.9. Let f be an initial function and (P)^On = coH'[/]. 
J/77* = r]*(coE'[f],uP,a) and p < P* a then / w "/3 < f u "a. 

Proof. First assume that 77* = 0, that is, f v a = a for all 77 < uj p . 
Then, by Clause 6, 

r p a = su P (r p ( 7 ) + i), 

7<ct 

so in particular /" P /3 < f^ P a. 

We now consider the case that 77* > and note that 

PP'a = p' + ^a = P'a 

for all r) < uj p . But this shows that 77* (coH' [f] , w p , p'a) = 0. 
It follows from the first case that, if f3 < p a, 



r p<r p a = r a . 



□ 
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We are now ready to prove our main theorem. 

Theorem 7.10. Iff is an initial function thencoil'[f] is its cohyperation, that 
is, 

coH'[/] =coH[/]. 

Proof Let (/«) ?e0 n = coH'[/]. 

In view of Lemma 17.81 all that remains for us to prove is that bounds 
every weak cohyperation gi, i.e., that /«C > ff«C for all 

Now we work by induction on £ and considering several cases depending 
of which clause defines f^a. 

Clauses 1-3. These clauses establish the desired inequality for £ < 2. 
Clause 4. Write £ = £' + lo p and let 77* = r?*(coH'[/], lo p , ft' a). We note that 
r f 'f 6 'a = F'f'ft'a = f uP f£' +r >*a 

and further 

r,*(coH'[/],^,/«' + "* a )-0. 

Now, we have by induction on £' + 77* < us p that f^ +v a > +v a, and thus 
we can use Lemma 1731 to see that 

f^p'fi'a = f u * 'ft' +r >*a > r P gt' +,1 'a > g^g^'+^a = g^a. 

Clause 5. In this case, £ = oj p and we have that 

where 77* = ? ? *(coH'[/], w", a) > 0. 

By induction we have g v a < f v a and we use Lemma [731 to see that 

r P a > fSgi'a > g"' >' 'a = g» f 'a. 

Clause 6. We see that 

f*a = su P (/«(/3) + 1) > sup(/(/3) + 1) > g*a, 

where the last inequality uses the assumption that g^ is initial. □ 

Like hyperations, cohyperations of cohyperations behave as one would ex- 
pect. We present the following without proof, which is very similar to its hy- 
peration analogue. 

Lemma 7.11. Iff is an initial function and^^Q arc ordinals then (/^)^ = f^ 
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8 Exact sequences 

One nice thing about cohyperations is that, in a sense, they need only be defined 
locally. To make this precise, we need the notion of an exact sequence. 

Definition 8.1. Let g be an initial function, (g^)^eOn — coH[g] and f : A — > Q 
be an ordinal function. 

Then, we say f is g-exact if, given ordinals £, C, /(£ + C) = 5 '/(£)■ 

A g-exact function / describes the values of <?^/(0). However, for / to be 
g-exact, we need only check a fairly weak condition: 

Lemma 8.2. Let g be an initial function and (<7^){eOn = coH[g]. 
Then, the following are equivalent: 

1. f is g-exact 

2. for every ordinal £, /(£) = ,g^/(0) 

3. for every ordinal Q > there is £ < £ such that /(£) = g~^ +< * f (£,) ■ 

Proof. It should be clear that condition 1 implies the other two, so we shall 
show that 3 implies 2 and 2 implies 1. 

3 => 2. Let / satisfy condition 3, and suppose inductively that, for all £ < £, 

f(0 = 9 S f(0). 

Pick f < C such that /(C) = ,g^ +c / (£)• Then, 

/(C) = <T €+C /(0 = ff- ?+C 5«/(0) = 5 C /(0), 

as claimed. 

2 1. Assume that / satisfies condition 2. We then see that, given £ < £, 
/(C) = 5 C /(0) = ff- ?+C //(0) = <T S+C /(0- 

□ 

Example 8.3. The sequence 

(£l,fTl,£l,...,2,0, ...) 

that is constant £\ for the first oj coordinates, 2 on the uj coordinate and 
after that is l-exact. 

Proof. By Example 17.61 and Lemma 18.21 □ 
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9 Inverting hyper at ions 

As promised, cohyperation provides left-inverses for hyperations. In this section 
we will show how this is obtained. 

Theorem 9.1. Suppose that f is a normal function and (/^)^eOn its hyperation. 
Let g be a left adjoint for f with cohyperation (<7^}£eOn- 
Then, g* is a left adjoint of /' for all £. 

Proof. We prove this by induction on £. 

Suppose that a < f^(3. If £ = 7 + 5 with 7, S < £, we see that a < f 1 f 6 'f3, 
so that g 7 a < f s /3 and thus g 5 g 7 a < 8. Strict equality and strict inequality are 
preserved by this argument. 

Thus we may assume £ = ui p for some p > 0. 

The case /3 = is also easy; recall that by Lemma [221 /(0) = 0, and thus 
f^O = for all £. But then, t^O is also for all £ because g^ is initial. 

So we assume that (3^0. Let us also suppose, inductively, that ([3]) and ((4]) 
hold for a', /?' whenever («) /3' < 8 or (ii) (3' = (3 and a' < a. 

Consider first the case that equality holds; a — f^" (3. Note that, if i] < uj p , 
by induction on £ = uj p , 

thus given (3, there is no rj < lu p with g v f uP 8 < f uP 8. 
It follows that g uP a is defined by Clause 6; that is, 

g^a= sup (g u "(a') + l) < 8, 

a'e[0,a) 

where the inequality follows by induction on a' < a, since if a' < a = f u ' ' (3, 
g u "a' < (3. 

Next we check that g^ P a. > (3. 

For all 8' < (3, we can assume by induction that g 10 f u (3' — f3' . But 
f""B' < f u "8 = a, and thus 

ft* a > sup (g" P r P ({3') + 1) 1 sup (8' + 1) = 0. 

Finally, let us see that if a < /^ P , then indeed g^a < (3. Here we proceed 
by induction on (3. 

If (3 is a limit ordinal, then a < f u f3' for some f3' < /3, in which case by 
induction hypothesis g u a < (3' < (3. 

If (3 = (3' + 1, a < P{f u "{B') + 1) for some r, < uj p . Thus, by induction 
on rj < £ = oj p , g v a < f uP {8') + 1, so that g v a < f u ' (3' and by induction on 

8'<j3, 

g u "a = g^g^a < j3' < B. 

□ 
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Corollary 9.2. If f is a normal function with hyperation (/^){gOn and g is a 
left adjoint to f with cohyperation (g^)^On, then, given ordinals £ < £ and a, 
<rf- f M andgtft=g-t+t. 

Proof. Immediate from Theorem 19. 11 writing ft = f^f~^ + ^ and = g^^ + ^g^. 

□ 

As an important example we mention hyperlogarithms, i.e., the cohyperations 
(L^)teOn and (^}| e on> wnere j recall, L(uj a + (3) = a (provided /3 < u a + /3) and 
t(a + uP) = f3. 

Corollary 9.3. The cohyperations L^,fi are left adjoints to the hyperations 
for all £. 

Proof. Immediate from Theorem 19.11 and the fact that L,£ are both initial left 
adjoints to e. □ 

Example 9.4. As seen in Example \ 6.'A e w 2 = e±; meanwhile, according to 
ExampleYTb\ fe x = 2. 

Then, t u e u 2 = 2, as predicted by Corollary\9J& 



Concluding remarks 

The work we have presented gives a general theory of two forms of iteration 
of ordinal functions which give natural alternatives to existing notions. The 
ordinals one may generate through hyperations are no larger than those given 
by Veblen progressions. However, the deep algebraic structure of hyperations 
and cohyperations has great advantages in applications, as the authors have 
found in their work in provability logics, and we trust that many mathematicians 
working routinely with ordinals will find our framework appealing. 

As with Veblen progressions, one may work with higher-order versions of 
hyperations, where iteration is applied to exponents of functions, thus facili- 
tating operations well beyond r . This is a direction well worth looking into, 
and possibly a necessary one if provability logics are to work their way into the 
analysis stronger and stronger theories. 

Moreover, one may also think of hyperations and cohyperations as special 
cases of iteration through additive sequences of functions. To be precise, one 
may think of hyperations (and similarly cohyperations) as operators of the form 
HyPc ; where C is a class of functions and F a criterion for selecting a preferred 
candidate from all right-additive function families in C. From this perspective, 
Hyp would become HypfJ^, where Nrm denotes the class of normal functions 
and min denotes pointwise minimization. We have studied the two versions 
which were most useful for a specific application; however, there are many more 
possibilities left to be explored. 
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